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ABSTRACT 
Given  a    general   arithmetic  expression,    we      find     a      computation     binary 
tree   representation   in  O(log  n)    time   using  n/log   n  processors. 
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1,    Introduction. 

The  model  used  In  the  present  paper  is  a  synchronous  model  of  parallel 
conputation  in  which  all  processors  have  access  to  a  common  memory. 
Simultaneous  reading  by  several  processors  from  the  same  location  is  allowed 
but  not  simultaneous  writing.  This  model  is  sometimes  called  the 
concurrent-read  exclusive-write  parallel  random-access-ma chine  (  CREW 
PRAM  ).  This  model  is  a  member  in  a  whole  family  of  models  for  parallel 
conputation.  See  Vishkin  [V-83b]  for  a  recent  survey  of  results  concerning 
this   family. 

We  present   two  algorithms: 

1.  For      the     problem     of      generating     a      tree     form     of      a     general 
arithmetic  expression. 

2.  For  matching  pairs   of   parentheses   in  a   given  sequence. 

Both     algorithms   are   of   depth  O(log  n)   using   n/log   n  processors   for   input    of 

n  characters.      Such  a    result   can  be  alternatively  stated   as    depth   of      0(n/p) 

for     p  <    n/log  n  processors.      Our   algorithms    have    "optimal   speed-up"    (or  are 

"optimal"    )   in  the    following   sense    :    The  depth   is    of   the   order  of   the     worst 

case     running   time   of  the   fastest  known  sequential  algorithm  over  the  number 

of    processors.     We  refer   the   reader   to   the    following   papers  for   some  optimal 

parallel   algorithms    in  respective   problems:    [SV-81]    for  finding   the   maximum, 

merging  and  sorting,    [AKS-83]    for  sorting,    [CLC-82]    and    [V-81 ]    for  computing 

connected      components      of      a     graph     and      [TC-82]      and    [TV-83]    for  computing 

biconnected  conponents    of   a    graph. 

Dekel  and   Sahni   [DS-83]    present   parallel   algorithms    for  generating     the 

postfix     arrl      tree     form  of   an  arithmetic  expression.      In   their   introduction 

they  give   a    comprehensive  discussion    justifying   the   importance   of   the   second 

problem.        We     nKntion      only      one   of   their   arguments    and   refer   the   reader  to 

their  paper  for     the      others      .        All     parallel     algorithms     for     evaluating 

arithmetic      expressions   work   on   their   tree   form.      See,    for   instance,    [Br-74] 

and   [Wi-75]  . 

The  Dekel-Sahnl  algorithm  runs   in   time   O(log  n)   using  n  processors    (But 

2 
in      order   to   achieve   O(log  n)    time   they  use  n   /log  n  processors).      Thus,    our 

algorithm  is  substantially  faster  using  less   processors.      They      adapted     the 

known      sequential     algorithm     to     run      in     parallel.      Like  Reif    [R-82] ,    they 

emxlate   the    stack  in  parallel.      In   contrast   to     this,      we     introduce     a      new 

"parallel     oriented"     algorithm.        Both     its      design     and     time  analysis    are 

simpler  if    the   parallel   point    of    view  is   adopted.      Dekel  and   Sahni  find     the 

postfix   form.      Then,   they  use   it   to  derive  the   tree   form.      We  could   not   find 

sufficient  significance   in   the     postfix     problem     itself     for     the      sake      of 
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parallel      computation.        However,     we  would  like   to   say   that  we   see  a  way   to 

find  it  in  O(log  n)    time  using  n/log   n  processors. 

They  use  a  more   restrictive  model  of      computation,      the      exclusive-read 

exclusive -write     (ERW)      PRAM     where      simultaneous      access     by  more    than   one 

processor   to   the    same   location   is    not  allowed.        An     implementation      of      our 

algorithm     in  their   model   using   the    general   simulations   of    [E-79]    or    [V-83a] 

2 
still   improves  over  their  result.      Our  algorithm  will   run  in     O(log  n)      time 

using  n/log   n  processors.      However,   we  believe  that   a   general   implementation 

of    the  EREW   PRAM  on  physically  realizeable  machines      (where     each      processor 

can     communicate   only  with   a  small  number  of   others   in  a   fixed   pattern)   will 

not   require    less   computational  resources   than   that    of   the  CREW  PRAM  on     such 

machines. 

The     matching     parentheses      algorithm     is     part      of    our  main  algorithm. 

However,    we    consider   it  to  be  of  independent   interest.      For  instance,    it   can 

be  used    for   finding   parse   trees   of    certains  families    of   structured   programs. 


2.    The  Algorithm. 

2.  1  Basics. 

Our      problem     is      to     find     the      binary      tree    representation  of  a    legal 

arithmetic  expression.      The  expression   is    given  in  an  array   of      size     n.      It 

may    include  constants,    variables,    the   binary  operators  +,-,*, /,**(power)   and 

parentheses.      The  precedence   order  among   the   operators      is      the     usual      one, 

i.e.        **,*    /,+  -     in     this      order.      We  follow  the   convention   that   the   power 

operator   is    right  associative   and  -,/  are  left  associative.      For  convenience 

+  and   *  are  regarded  left  associative   as   well. 

Example.  a*f 
—                              a/b/c**d**e*f   =   ( (a/b)/(c**(d**e) ))*f 


b*c^" 


The  ixides  of  this  tree  will  correspond  to  the  operands  and  operators  in 
the  expression.  The  problem  is  to  connect  properly  these  nodes.  We  first 
look  at  an  easier  problem  :  an  expression  with  operators  of  the  same 
precedence  and   no  parentheses . 

As  can  be  seen  from  Figure  1  the  tree  form  of  the  expression  is 
determined  by  the  (left  or  right)  associativity  of  the  operators.  For 
example,  in  Figure  la  the  operators  are  left  associative.  Thus,  every 
operator  becomes  the  parent  of  the  previous  one  and  every  operand  is  the 
right  son  of  the  oprator  to  its  left  (except  for  the  first  one  which  is  the 
left     son  of  the   operator   to   its    right).      A  similar   technique  will  apply   for 
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^'  C 

a**b**c 

(b) 

Fig.    1.      A  tree  form  of    an  expression  with  operators   of    the  same   precedence  and  no 
parentheses. 

right  associative  expressions  producing  the  tree  form  as  in  Figure  lb.  We 
leave   the  details   to   the   reader. 

Our  approach  is  to  reduce  the  tree  form  problem  into  many  subproblems, 
each  of  finding  the  tree  form  of  an  subexpression  of  the  simpler  type.  The 
combined  result  will  give  us  the  desired  tree  form.  We  shall  do  so  in 
Section  2.3.      Let   us  first   present  the  matching  parentheses   algorithm. 

2 . 2  Matching  pairs   of    parentheses. 
Input.      An  array   of    length  n  containing  a  legal   sequence   of  parentheses. 
The  parentheses-matching  problem.      For  each    (left   or  right)     parenthesis      in 
the   sequence    find    its   matching   parenthesis. 

We  show  how  to  solve  the  parentheses-matching  problem  in  time  O(log  n) 
using   n/log  n  processors. 

(1)  Partition  the  array  into  n/log  n  successive  segments  of  length  log  n 
each,    and    assign  a    processor  to  each  segment. 

Each  segment  contains  some  matching  pairs  of  parentheses  and  some 
parentheses   whose   matches   are    outside  it. 

(2)  Each  processor  finds  the  pairs  of  matching  parentheses  in  its  segment 
and  mark  them  as  "marked  in  step  2".  This  can  be  done  in  one  pass  on  the 
segment  using  a  simple  stack  in   the   obvious  way. 

This   takes   O(log  n)    time. 

The  unmatched    parentheses   in     each     segment      form     a      series      of      right 
parentheses      followed  by  left   ones,    i.e.,    )...)(...(    .      Let  us    refer   to    these 
new   sequences   as   the   subsequences. 

(3)  Each  processor   finds   the   match   of   the      innermost     left      (leftmost),      and 
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innermost  right  (rightmost)  parentheses  in  its  subsequence  by  searching  over 

the   whole   sequence.    It  marks  them  as  "matched  in  Step  3"  (as  opposed  to 

"matched  in  Step  2"). 

We  shall  show  later  in  this  subsection  how  this  search  is  done   in  O(log  n) 

time. 

The  explanation  below  ignores  the  parentheses  matched  in  step  2. 

Each  pair  of  parentheses  matched  in  this  step  induces  an  interval  on 
the  sequence.   It  consists  of  the  parentheses  between  this  pair. 

Claim  :  The  parentheses  that  belong  to  an  interval  but  to  none  of  its 
inner  intervals  can  come  only  from  the  two  extreme  subsequences,  the 
subsequence  to  which  the  left  inducing  parenthesis  belongs  and  the 
subsequence  to  which  the  right  one  does.  Furthermore,  the  matching 
parentheses  appear  in  these  two  subsequences  in  consecutive  nesting  order. 

Proof.  Suppose  there  are  some  other  subsesequences  between  these  two. 
All  members  of  these  subsequences  are  contained  m  the  intervals  induced  by 
either  their  innermost  left  or  right  parentheses  that  were  matched  in  Step 
3.  The  extreme  subsequence  to  the  left  contains  the  left  parentheses  in  a 
row  and  the  one  on  the  right  the  right  ones.   See  Figure  2. 

To  conclude, 

(4)  Each  processor  starts  with  its  innermost  right  parenthesis  and  proceeds 
to  match  its  unmatched  right  parentheses  from  right  to  left  until  it 
encounters  another  parenthesis  that  was  marked  in  Step  3  or  until  it 
finishes  scanning  its  segment.  Later,  each  processor  starts  with  its 
innermost  left  parenthesis  and  proceeds  to  match  its  unmatched  left 
parentheses  in  a  similar  way. 

Since  each  processor  scans  at  most  log  n  parentheses  this  step  takes 
O(log  n)  time. 

It  remains  to  show  how  each  processor  finds  a  match  for   its   innermost 

)(((((((    •••    )  )  )  (    •••    )  )  )  ( 
\  K  bi d^  d_ d^        c^c^ c^  a^ a^a. 

The  pairs  (a;,bt),  (ax.bi)  belong  to  the  interval  induced  by  (a^- ,bi  ). 
The  pairs  (c^.di.),  (c^^.d^)  belong  to  the  interval  induced  by  (c^.dc  ). 

Fig.  2. 
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parentheses.   For  this  we  use  a  balanced  binary  tree  on  which  each  processor 

performs  a  variant  of  binary  search. 

The  leaves  of  the  tree  will  correspond  to  the  sequence  of  parentheses. 

Remark  :  Note  that  it  is  possible  to  ignore  the  parentheses  matched  in 
step  2.  Complexity  and  correctness  will  not  be  affected. 

Initialization  of  the  binary  tree. 

(1)  At  each  leaf  we  compute  the  level  of  nesting  of   its   (left  or   right) 

parenthesis  as   follows.   For  a  leaf  corresponding  to  a  left  (resp.   right) 

parenthesis  we  enter  1  (resp.   -1)  into  a  standard  "partial  sum"  computation 

performed  on   the   tree.   Denote  these  ones  and  minus  ones  by  ej^  ,e2  ,  • . .  ,6^^. 

As  a  result  of  this  computation  we  get  L(i)  =  Z  e ^  at  leaf  j,  1  <  j  <  n. 

l<j<i  J 
This  computation  takes  O(log  n)  time  using  n/log  n  processors.   For   details 

see   [Wy-79] ,   [CLC-82]   or   [V-81].    Roughly,   the  computation  proceeds  as 

follows:  An  upsweep  of  the  tree  (from  the  leaves  to  the  root)  is   performed. 

Following   this  each  internal  node  has  the  sum  of  its  descendents.   Then  a 

downsweep  is  performed  in  which  partial  sums  relative  to  the  whole  tree  are 

computed. 

Obviously,   L(i)   (resp.   L(i)+1)  is  the  level  of  nesting  in  case  there  is  a 

left  (resp.   right)  parenthesis  at  location  i. 

(2)  For  each  internal  node  of  the  tree  four  numbers  are  computed: 
MAX-LEFT(j),  MAX-RIGHT( j),  MIN-LEFT(j)  and  MIN-RIGHT( j  ).  MAX-LEFT(j)  stands 
for  the  maximum  L(i)  taken  over  descendents  of  j  which  are  left  parentheses. 
The  definition  of  the  other  three  numbers  should  be  clear.  The  computation 
of  this  four  numbers  for  all  internal  nodes  of  the  tree  can  be  done  in 
O(log  n)  time  using  n/log  n  processors.  A  similar  procedure  to  the  previous 
partial  sum  algorithm  will  do  so.  (For  instance 
MAX-LEFT(j)  =  Max(MAX-LEFT(g),MAX-LEFT(h))  where  g,h  are  the  children  of  j. 
A  binary  Max  operation  replaces  the  binary  sum  operation,  and  there  is  no 
need  for  a  downsweep  part). 

The  search  procedure. 

Now  suppose  we  are  given  a  right  parenthesis  at  location  i  and  we  want 
to  find  its  match.  Its  matching  left  parenthesis  is  at  the  closest  location 
j,  j  <  i  such  that  j  has  a  left  parenthesis  and  L(j)  =  L(i)  +  1.  The  search 
procedure  has  two  step. 
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(1)  Find  an  ancestor  k  of  location  j  in  the  following  way  :  We  climb  up 
the  tree  from  the  leaf  i  towards  the  root  until  we  arrive  at  the  right  son 
of    sorae   node  whose   left   son  k  satisfies^    : 

MTN-LEFTCk)  <    L(i)    +    1  <    MAX-LEFT(k). 

(2)  Find    j.    Starting  from  the  node  k,    found  above,    we   go   down  the   tree 
aJways  choosing   right  sons   if   possible,    and   left   sons   if    not.      More 
precisely,    say  that   we   are   at   an   internal  node  whose  right  son  is   h,    and 
left   son   is    g.    If 

MIN-LEFr(h)  <    L(i)    +   1  <   MAX-LEFT(h)  proceed   to  h,    else   proceed   to 

g* 

The  search  for  a  right  parenthesis  is  very  similar.  The  search  for  one 
nBtch  amounts  to  climbing  up  and  climbing  down  the  tree,  each  on  a  path  of 
length  log  n  at  most,  performir^g  a  constant  time  operation  at  each  step. 
Thus,  the  running  time  of  one  search  is  O(log  n).  Summing  it  up,  the  total 
running  time  of  the  whole  matching  parentheses  algorithm  is  O(log  n)  using 
n/log  n  processors. 

For  example,    let 

()((()())())(()) 
be  the  a    sequence   of  N=16   parentheses,    logN  =   4,  N/logN=4  processors. 

Processors  PI  P2  P3  P4 

Input  (    )    (    (         (    )    (    )         )    (    )    )         (    (    )    ) 

Output  (    (  )    )  

Processor  PI  finds  the  match  for  its  leftmost  left  parenthesis  through 
the  path  A-B-C-D-E  in  Figure  3.  At  the  same  time  processor  P3  matches  the 
same  pair  through  the  reverse  path.  In  the  next  step  the  inner  pair  will  be 
matched^ . 


1)  A  more  efficient  way  of  climbing  (not  in  the  worst  case)  is  to  go  to  the 
parent  of  the  node  to  the  left  when  the  current  node  is  a  left  son  of  its 
parent. 

2)  For  simplicity  we  ignore  the  parentheses  matched  in  step  2.  The  reader 
can  see  by  himself   that    complexity   and   correctness   are   not  affected. 
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fl  (  (  )  )e 

1  2  1  0 

Fig.    3,      The  binary  tree  structure. 


2. 3  Finding   the  tree  form  of    the  expression. 

We  conjecture  that  finding  the  matching  pairs  of  parentheses  in  the 
expression  is  at  the  heart  of  our  main  problem.  Furthermore,  we  conjecture 
that  a  solution  to  this  subproblem  is  of  order  J2  (log  n)  time  if  optimal 
speed-up  is  required.  Note  that  we  were  able  to  achieve  the  best  possible 
performance  on  parallel  machines  in  the  remaining  parts  of  our  algorithm, 
i.e,  constant  time  using  n  processors.  To  show  this  we  assign  in  these 
parts,  a  processor  to  each  character  (total  of  n  processors),  and  perform  an 
0(1)  time  procedure.  This  can  be  readily  simulated  in  O(log  n)  time  using 
n/log  n  processors. 

Definition;  A     simple     expression  is  an  expression   in  which  all  operators 

not   enclosed  by  parentheses   are   of   the   same  precedence. 
For  example    :    a+(b/c)-d   is  a   simple  expression. 

We  shall  refer  to  an  expression  inside  outermost  pair  of  parentheses  as 
both  a  subexpression  and   an  operand   in  the    simple  expresson. 

Recall  the  examples  given  before  of  parentheses  free  expressions  whose 
operators  are  of  the  same  precedence.  Simple  expressions  are  very  similar 
to  them.  The  only  difference  is  that  in  simple  expressions  some  "operands" 
may  be  expressions  themselves.  The  tree  form  of  these  operands,  viewed  as 
subexpressions,  are  proper  subtrees  in  the  whole  tree.  The  roots  of  these 
subtrees  appear  in  the  tree  of  the  simple  expression  as  if  they  were 
operands  which  replace  the  subexpressions.  We  use  the  above  approach  to 
analyze  the  expression  at  hand. 

Step    1.      We   insert   parentheses    in   the  expression   so   that    all     subexpressions 
in  it,    in  all  levels   of   nesting,   become  simple  expressions. 


i)  For  each  +,-  operator  we  insert  two  left  parentheses  to  its  right 
and   two   right   ones   to   its    left. 

ii)  For  each  *,/  operator  we  insert  a  left  parenthesis  to  its  right  and 
a   right  one    to   its    left. 

iii)  For  each  left  (resp.  right)  parenthesis  we  insert  two  additional 
left  (resp.    right)   parentheses   to   its    right    (resp.    left). 

In  addition  two  left  parentheses  are  added  at  the  beginning,  and  two 
right   ones   at   the  end. 

For  example,    the  expression  a+b*c**d**e 
Is    transformed   into    ( (a) )+( (b)*(c**d**e) ). 

Later  the  redundant  parentheses  are  deleted. 
Implementation  remark  :  A  processor  is  assigned  to  each  entry  of  the  array. 
A  processor  inserts  new  parentheses  by  replacing  the  previous  character  in 
its  entry  by  a  pointer  to  a  link  list  containing  the  previous  character  and 
the  new  parentheses  in  the  appropriate  order.  The  length  of  each  such 
linked   list   is   at  most   5. 

Step  2.  Apply  the  parentheses  matching  algorithm  to  the  expression. 
Implementation  of  this  algorithm:  A  processor  is  assigned  to  a  segment  of 
length  log  n  in  the  original  array.  It  finds  the  matching  parentheses  in 
the  string  corresponding  to  its  segment,  and  then  forms  the  balance  binary 
tree.  In  doing  so,  it  skips  on  characters  which  are  not  parentheses;  and  if 
an  entry  contains  a  pointer  to  a  linked  list  it  scans  the  whole  list.  The 
location  of  parentheses  in  the  linked  lists  is  denoted  by  their  entry  number 
in  the  array  and  their  position  in  the  linked  list.  Since  there  are  at  most 
51og  n  characters  in  a  segment  the  total  complexity  is  O(log  n).  We  leave 
the  details    to   the   reader. 

Step  3.  To  make  things  simpler  we  delete  redundant  parentheses  in  the 
following  way  :  Every  right  parenthesis  "deletes  itself"  if  there  is  another 
right  parenthesis  to  its  left,  and  their  corresponding  left  matches  are  also 
adjacent.  Similarily  a  left  one  "deletes  itself"  if  there  is  another  one  to 
its  right,  and  their  matches  are  adjacent.  In  addition  a  left  (right) 
parenthesis  "deletes  itself"  if  it  encloses  one  operand  only.  We  delete  an 
element  by  replacing   it  with   a  null  character. 

Step  4.  Forming  the  tree.  As  before,  a  processor  is  assigned  to  each  entry 
of  the  array.  Each  processor  handles  its  character (s)  as  part  of  the  simple 
expression   containing   this    character. 
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i)   Processors  assigned   to   parentheses    are   active,    all  others  are    idle. 

Each  pair  of  parentheses  encloses  a  subexpression.  The  root  of  the 
tree  form  of  this  subexpression  represents  an  operand  in  the  simple 
expression  containing  it.  The  subexpression  is  itself  a  simple  expression. 
Therefore  the  root  is  either  the  first  or  the  last  operator  in  it,  depending 
on  the  precedence  class  of  its  operators.  In  either  case  it  takes  0(1)  time 
to  find  the  root.  The  processor  of  the  left  parenthesis  finds  the  first 
operator  as  follows.  If  the  entry  to  its  right  contains  a  constant  or  a 
\7ariabJ£  then  the  operator  is  in  the  next  entry.  Otherwise,  the  entry 
contains  a  left  parenthesis.  The  operator  is  in  the  entry  next  to  the 
corresponding  right  match.  Likewise,  the  right  parenthesis  finds  the  last 
operator.  Pointers  are  set  to  identify  the  root  with  the  pair  of 
parentheses. 

ii)   Processors   assigned    to  operators  are   active,    all  others  are    idle. 

Suppose  the  operator  is  one  of  +,-,*,/.  The  previous  operator  is  set 
to  be  its  left  son,  and  the  operand  to  its  right  its  right  son.  The 
processor  finds  them  as  follows:  If  the  entry  to  the  left  of  the  operator 
contains  a  constant  or  a  variable  then  the  previous  entry  contains  the 
operator.  Otherwise,  the  entry  contains  a  right  parenthesis.  The  operator 
is  in  the  entry  to  the  left  of  the  left  match.  The  entry  on  the  right 
contains  the  operand  (If  this  is  a  left  parenthesis  then  the  node  is  the 
corresponding  root).  Note:  If  instead  of  the  previous  operator  a  left 
parenthesis  is  found,  we  conclude  that  our  operator  is  the  first  operator. 
^<fe  therefore,  set  its  left  operand  which  is  in  the  entry  to  its  left  to  be 
its   left   son. 

The  reader  can  verify  that  a  similar  procedure  will  do  for  the  ** 
operator.  Only,  the  left  operand  is  set  to  be  its  left  son,  and  the  next 
operator  (with  the  exception  of  the  last  operator)  its  right  son.  This  does 
not    involve  any  new  ideas. 

Note:  A  processor  initially  assigned  to  an  entry  containing  a  pointer 
to  a  linked  list  perform  steps  3,4  for  each  character  in  its  list.  This 
takes  a  constant  time  since  there  are  at  most  5  characters.  Null  characters 
are  being   skipped. 

We     have      shown      throghout      the      paper     that      our     algorithm     correctly 
construct    the   binary  tree   form  of   the  expression. 
We  conclude   with   an  example    : 

Let   the  expression   be  a/b+c**(d/e+f**g). 

After  inserting  parentheses   we   get: 
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((a)/(b)>+((c**(((d)/(e))+((f**g))))). 
Deleting   the   redundant    ones  we   get: 

(a/b)+(c**((d/e)+(f**g))). 
The  binary  tree    representation  is    given  in  Figure  4. 

Complexity  .  Step  2  runs  in  0(n/p)  time  using  p  <  n/log  n  processors. 
The  remaining  steps  run  in  0(n/p)  time  for  p  <  n  processors.  Thus,  the 
total  irunning   time   is   0(n/p)   for  p  <    n/log  n   processors. 

Remark  :  We  can  improve  the  evaluation  time  of  the  tree  form  by 
decreasing  the  number  of  divisions  needed.  To  do  so  we  shall  regard  the 
division  operator  as  having  higher  prcedence  than  multiplication.  Treat  the 
division  operator  as  right  associative  and  replace  all  but  the  first  one  in 
these  "division  simple  expressions"  by  multiplication.  See  example  in 
Figure  5. 


Fig.    4.        The  tree  representation  of    a/b+c** (d /e+f * *g ) . 


Fig.    5.      Binary  tree  form  for  a/b/c/d, 
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